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Creating a bridge clip for seamless connection of multimedia sections without requiring 
recoding 



TECHNICAL FIELD 

The present invention is generally related to manipulating multimedia data 
streams and more particularly to a method, devices and a computer program product for 
bridging two multimedia stream sections. 

5 

BACKGROUND OF THE INVENTION 

In recent years tiiere have been developed a number of standards for recording 

multimedia data on data carriers, examples of such standards being DVD (Digital Versatile 

Disc) and Blu-ray disc video. In for instance Blu-ray it is possible to allow a user to 
1 0 seamlessly coimect together two streams or clips provided on a Blu-ray disc. 

The user does this by manipulating a so-called playlist, which list poin.ts at 

streams or clips that are to be played. One way of providing a seamless connection is by 

using a so-called bridge clip, which is created from the two streams and stored on thes disc. 

The inclusion of a bridge clip then allows the user to seamlessly jump from a positioo in a 
1 5 first of the clips to another position in another of the clips without having to change tlie 

original clips. 

One way of doing this is described in EP-1 198133, which describes the? 
creation of a bridge clip from material in tihie furst clip and material in the second clip. In the 
creation of this bridge clip, however, some of the data of the original clips are recoded before 
20 being provided in the bridge clip. Such recoding is fairly complex, requires quite heavy 
processing and is therefore expensive by nature as well as slow. This typo of bridge clip 
creation is therefore normally suitable for professional editing of multimedia streams. 

However it would be interesting to provide this type of functionality also 
within a consumer market, in which case there is a need for a less complex way of providing 
25 a bridge clip in multimedia editing situations. 
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SUMMARY OF THE INVENTION 

The present invention is therefore directed towards solving the above- 
mentioned problem of providing bridge-clips in a more simple way in for instance consumer 
equipment. 

5 One object of the present invention is thus to provide a method of providing 

bridge-clips in a more simple way that do not require recoding of multimedia streams. 

According to a first aspect of the present invention, this object is achieved by a 
method of bridging two multimedia stream sections comprising the steps of: 

detecting user-selected switching from a first to a second section at a certain 
10 exit time of the first section and a certain entry time of the second section, 

determining an exit location based on the user selected exit time in the first 
section, which exit location has a sequence start marker, 

selecting all media packets in the first section associated with the sequence 
start naarker and possible media packets provided afl:er the exit location associated with 
15 previous sequences in the first section, 

creating a sequence end marker for selected media packets of the first section, 

determining an entry location based on the user-selected entry time in the 
second section, which entry location has a sequence start marker, 

selecting stream control information provided in the second section before the 
20 entry location, and 

creating a bridge clip comprising copies of said selected media packets in the 
first section, the sequence end marker, a copy of said selected stream control information as 
well as possible filling packets, 

such that the bridge clip can be played between the entry and exit locations for 
25 providing seamless connection between the two sections. 

Another object of the present invention is to provide a device that creates 
bridge-clips in a simple way that does not require recoding of multimedia streams. 

According to a second aspect of the present invention, this object is achieved 
by a device for bridging two multimedia stream sections provided on a storage medium (18) 
30 and comprising: 

a reading and a writing unit for reading and writing multimedia data on the 
storage medium, and 

a control unit for manipulating at least one multimedia stream provided on the 
storage medium, 
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wherein the control unit is arranged to: 

detect user-selected switching from a first to a second section at a certain exit 
time of the first section and a certain entry time of the second section, 

determine an exit location based on the user selected exit time in the first 
5 section, which exit location has a sequence start marker, 

select all media packets in the first section associated with the sequence start 
marker and possible media packets provided after the exit location associated with previous 
sequences in the first section, 

create a sequence end marker for selected media packets of the first section, 
10 determine an entry location based on the user selected entry time in the second 

section, which entry location has a sequence start marker, 

select stream control information provided in the second section before the 
entry location, and 

create a bridge clip comprising copies of said selected media packets in the 
1 5 first section, the sequence end marker, a copy of said selected stream control information as 
well as possible filling packets, 

such that the bridge clip can be played between the entry and exit locations for 
providing seamless connection between the two sections. 

Another object is to provide a multimedia data presentation device that creates 
20 bridge-clips in a simple way that does not require recoding of multimedia streams. 

This object is achieved according to a third aspect of the present invention by 
a multimedia data presentation device comprising a device for bridging two multimedia 
stream sections according to the second aspect of the invention. 

Another object of the present invention is to provide a computer program 
25 product that creates bridge-clips in a simple way and that does not require recoding of 
multimedia streams. 

According to a fourth aspect of the present invention, this object is achieved 
by a computer program product to be used on a computer for bridging two multimedia stream 
sections and comprising a computer program code for making the computer execute, when 
30 said code is loaded into the computer, the following functions: 

detect user-selected switching from a first to a second section at a certain exit 
time of the first section and a certain entry time of the second section, 

determine an exit location based on the user selected exit time in the first 
section, which exit location has a sequence start marker, 
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select all media packets in the first section associated with the sequence start 
marker and possible media packets provided after the exit location associated with previous 
sequences in the first section, 

create a sequence end raarker for the selected media packets of the first 

5 section, 

determine an entry location based on the user selected entry time in the second 
section, which entry location has a sequence start marker, 

select stream control information provided in the second section before the 
entry location, and 

10 create a bridge clip comprising copies of said selected media packets in the 

first section, the sequence end marker, a copy of said selected stream control information as 
well as possible filling packets, 

such that the bridge chp can be played between the entry and exit locations for 
providing seamless connection between the two sections. 
15 Claim 2 is directed towards providing the exit and entry locations as the 

locations that are closest to the user-selected exit and entry times in order to minimize the 
offset from the desired exit and entry times. 

According to claim 3, the selected stream control information is the closest 
information in previous sections of the second section. In this way the most relevant 
20 information is used and unnecessary searching is avoided. 

Claim 4 is directed towards including in the bridge clip a number of media 
packets of the second section after the actual entry point, which might be necessary in order 
to meet requirements of the recording standard used. 

Claim 5 is directed towards including in the bridge clip a number of media 
25 packets of the first section before the actual exit point, which might be necessary in order to 
meet requirements of the recording standard used. 

According to claim 6, the media packets include video packets, the sequence 
end marker being provided after the last video packet associated with the sequence start 
marker. This is done in order to clearly define the end of the video information originating 
30 from the first section, which might also be necessary in order to meet requirements of the 
recording standard used. 

According to claims 7 and 8, null packets are inserted in the bridge clip 
between non-selected media packets and selected audio packets originating from the first 
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section or packets originating from the second section, which might be necessary in order to 
meet requirements of the recording standard used. 

Claim 9 is directed towards using overhead data in the form of entry point 
maps in locating sequence start markers, which makes the locating process fast and efficient. 
5 Claim 10 is directed towards creating an entry point map for the bridge clip 

based on entry point maps of the first and second sections, which might be necessary in order 
to meet requirements of the recording standard used. 

Claims 11 and 12 are directed towards bridging sections provided in the same 
stream and in different streams, respectively. 

10 With the present invention, the creation of bridge-clips is achieved, without 

the need to recode multimedia streams, but by just copying and the possible addition of null 
packets and/or stream control packets. Because of this, the bridging is enabled at small cost 
and without the complexity associated with said receding. The creation of a bridge-clip is 
finrthermore fest and can be performed without any perceivable delays to the user. The 

15 invention furthermore does not need an encoder for its implementation, which means that it 
can be provided in an overall simpler and cheaper device. 

The basic idea of the invention is to detect a user-entered exit time firom a first 
multimedia stream section to an entry time to a second multimedia stream section, determine 
an exit location based on the user-selected exit time and an entry location based on the user- 

20 selected entry time, which entry and exit locations each have a sequence start marker, select 
all media packets associated with the sequence start marker and possible media packets 
provided after the exit location associated with previous sequences in the first section, create 
a sequence end marker for selected media packets of the first section, select stream control 
information provided in the second section before the entry location, and create a bridge clip 

25 comprising copies of said selected media packets in the first section, the sequence end 

marker, said selected stream control information as well as possible filling packets. In this 
way the bridge clip can be played between the entry and exit locations for providing seamless 
connection between the two sections. 

The above-mentioned and other aspects of the invention will be apparent from 

30 and elucidated with reference to the embodiments described hereinafter. 



BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be further described in relation to the 
accompanying drawings, in which: 
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Fig. 1 shows a block schematic of a multimedia presentation device 
comprising a device for bridging two multimedia stream sections according to the present 
invention, 

Fig. 2 schematically shows two transport streams that are to be bridged. 

Fig. 3 schematically shows the creation of a bridge clip from the two transport 

streams according to the present invention, and 

Fig. 4 schematically shows a computer program product in the form of a CD 

ROM disc having a computer program code for performing the method according to the 

present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

The present invention is generally directed towards seamlessly interconnecting 
sections of multimedia streams without recoding of the multimedia content. In the following 
a system for providing this facility will be described in relation to MPEG-coded multimedia 
data in the form of MPEG transport streams that are stored on an optical disc according to the 
Blu-ray standard. It should however be realized that the invention is not limited to Blu-ray or 
even MPEG, but can be used on other standards having suitable similar properties. The 
invention is furthermore not limited to such multimedia streams being provided on an optical 
disc, but includes storage of such multimedia streams on any suitable storage medium, like 
hard discs or memory sticks. 

Fig. 1 shows a block schematic of a multimedia presentation device 10 in the 
form of a simplified Blu-ray player. The player includes an optical disc drive 14 arranged to 
receive a Blu-ray disc 18 on which is stored a nimiber of multimedia streams coded 
according to the Blu-ray standard. The disc drive 14 is connected to a device 12 for bridging 
two multimedia stream sections in the form of a Blu-ray coder/decoder, which device 12 is 
indicated by a dashed box. A user interface unit 16 is connected to a control unit 26 of the 
device 12 in order to allow a user to make selections of multimedia streams or clips to be 
played and also to bridge one stream with another in a seamless fashion. The device 12 
therefore comprises a reading unit 20 connected to the disc drive 14 for reading information 
on the disc 18. The reading unit 20 is furthermore connected to a stream separating unit 22, 
which removes additional data that is encoded with a transport stream of MPEG multimedia 
data. The stream separating unit 22 is connected to the control unit 26, to a buffer 24 and to a 
multimedia decoding unit 32, which multimedia decoding unit 32 provides decoded 
multimedia signals, which in this embodiment are decoded MPEG video and audio signals 
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for a television set. In order to write data onto the disc 1 8, a writing unit 30 is connected to 
the disc drive 14, which writing unit 30 is further connected to a stream combining unit 28, 
and the stream combining unit 28 is connected to both the control unit 26 and the buffer 24. 

In Fig. 1 the device 12 is provided for only plajdng multimedia data in order to 
5 better describe the invention. It should however be realised that it could just as well be 

provided with actual multimedia recording facilities, in which case there would be required a 
multimedia coding unit. The multimedia decoding xmit 32 is a standard MPEG decoder, 
which separates the audio and video stream from each other and decodes the coded video and 
audio information. It should also be realised that there might be several buffers provided for 

10 temporary storage of different multimedia streams. 

Fig. 2 schematically outlines two transport streams TSl and TS2 or two video 
clips, which are retrieved from the disc 18. The streams include a number of multimedia 
packets grouped into frames. In the first stream TSl there is a first frame Vi of video packets 
next to another frame of video packets Va- Spaced from this frame V2 there are a number of 

15 audio packets Ai, which are associated with the video frame Vi,and yet further forward there 
are a number of audio packets A2, which are associated with the video frame V2. The video 
frame V2 has a first data packet that has a section start marker or section start code, which 
indicates the start of a section having a GOP (Group of Pictures) I-frame. This means that 
this packet has all video information necessary for showing a certain scene. The packet 

20 ftirthermore has a timestamp and is associated with an entry point table EPi provided as 
overhead information in relation to the first transport stream TSl and thus outside this 
transport stream, and including such information as the number of packets in the sequence. 
This entry point table EPi directly points at the sequence start code, which makes it easy to 
locate. 

25 The second transport stream TS2 includes a number of stream control packets 

SC, which can be PAT (Program Association Table), PMT (Program Map Table) or PGR 
(Program Clock Reference) packets according to the Blu-ray standard which are separated 
from a frame of video packets Va^ wherein the first packet of this frame also has a data packet 
that has a section start code, a timestamp and is associated with an entry point table EP2 

30 provided as overhead information in relation to and outside the second transport stream TS2. 
This frame V3 thus also has a GOP I-frame. At a distance from the video frame V3 there is 
provided a number of audio packets A3 associated with this video frame V3. The reason for 
providing audio packets distanced from the video packets is that the processing of audio and 
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video in the decoder 32 takes up different amoiints of time. The end result is however that 
these should be provided to the user so as to be synchronized v^^ith each other. 

An embodiment of the present invention will now be described with reference 
being made to Figs. 1, 2 and 3, where Fig. 3 shows a schematic view of the transport streams 
5 TSl and TS2 as well as a bridge clip BC that is created according to the invention. 

A user wanting to play a piece of multimedia can select this by editing a 
playlist provided by the control ixnit 26. For the sake of explaining the present invention, it is 
assumed that the user has selected the multimedia stream TSl, which is stored on the disc 18, 
for playing. In this case the reading unit 20 reads the data from the disc, the stream separating 

10 unit 22 separates overhead data, such as the entry point map EPi, from the transport stream 
TSl and provides this information to the control unit 26. The rest of the data, i.e. the 
transport stream TSl, is forwarded to the decoder 30, which decodes the stream in a normal 
and well-known fashion. 

As mentioned before, the user can set up a playlist, where he for instance 

15 wants to play the first transport stream TSl first and then the second transport stream TS2. 

This playlist is entered using the interface 16. One option that exists is tihiat the user can select 
to bridge the transport streams TSl and TS2, i.e. connect the first transport stream TSl with 
the second transport stream TS2, somewhere in the middle or vice versa. In the present case 
this possible selection is one that should not influence or change the transport streams TSl 

20 and TS2, i.e. they should be possible to play to the fiiU extent at a later time even though the 
user selects to make a bridging. 

When the user makes such a selection, he selects an exit time from the first 
stream and an entry time into the second stream. These selections are made via the interface 
16 and thus detected by the control unit 26. As a result of these selections, the control unit 26 

25 furthermore enters markers or points in the form of timestamps into the streams TSl and 
TS2, which are indicated by a user-selected out time or exit time USEX in the first stream 
TSl and a user-selected in time or entry time USEN in the second stream TS2 in Fig. 3. 

The control unit 26 then looks forwards and backv^^ards in the first stream TSl 
around the user-selected exit time for a section start code. This is done using the 

30 corresponding entry point tables associated with the stream, which the control unit 26 has 
received from the stream separating unit 22. The control unit 26 then detennines an actual 
exit location AEX of the first stream TSl, which points to the first video packet of the frame 
V2. It thus connects the user-selected exit point USEX with this section start code. The 
location selected is the one that is closest to the user-selected exit time in either direction, i.e. 
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backwards or forwards, and thus the closest frame that has a GOP I-frame. Because of the 
Blu-ray standard this change is never more than 0.5 seconds, which is exact enough for most 
consumer applications. The control unit 26 also selects a number of multimedia packets to be 
used in the bridging process. It selects a number of video packets of the frame V2 associated 
5 with this section start code as well as all the audio packets A2 associated with this section 
start code. The frame V2 contains the last video packet of the first stream TSl that is to be 
presented. It also selects possible media packets associated with previous section start codes 
provided between the pointer and the last audio packet of A2. In the preferred embodiment 
the t5^e of packets selected here are audio packets. These selected packets have timestamps 
10 that are equal to or smaller than the timestamp of frame V2. Here the packet Ai is thus also 
selected, which is associated with the video frame Vi of a previous section in TSl. A number 
of packets Vi before the section start code are also selected. The selected packets are copied 
to the buffer 24. 

In the same memner, the control unit 26 looks at the second stream TS2, in 

15 which the control unit 26 has entered an entry point corresponding to the user-selected entry 
time USEN. It searches for a section start code in both directions, i.e. backwards and 
forwards from the user-selected entry point USEN, by looking at entry point tables and then 
identifies the entry point table EP2 which points at a section start code associated with a video 
frame V3, that includes all necessary video information for a scene, i.e. a GOP I-frame. Also 

20 this actual entry point AEN is the point having a sequence start code that is the closest to the 
user-selected entry point USEN. The control unit 26 then makes this point the actual entry 
point AEN and associates the user-selected entry point USEN with this actual entry location. 
Thereafter the control unit 26 searches the second transport stream TS2 backwards in order to 
find the latest streaming control packets SC, i.e. the last such packets before the actual entry 

25 location AEN, which it selects. These packets are such packets as PGR packets, PAT packets 
and PMT packets. The control unit 26 furthermore selects a number of video packets of the 
frame V3 associated with the actual entry location. The control imit 26 then copies the 
selected packets into the buffer 24. 

Once all this information has been copied into the buffer from the two 

30 transport streams, the control unit 26 goes on and creates a bridge clip BC out of the data in 
the buffer 24. The bridge clip BC starts with the extra packets Vi followed by the packets V2. 
Thereafter it creates and places an end of section marker or code E after the last video packet 
of frame V2. After this end of section code E, it places the audio packets Ai associated with 
previous video frames of TSl. Thereafter it creates one or more null packets N corresponding 
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to the amount of packets provided between Ai and A2 in the stream TSl followed by the 
audio packets A2. The control unit 26 then adds a number of null packets N in order to pad 
the audio packets to an aligned unit boundary, which might be necessary in order to meet 
requirements of the recording standard used. After these null packets N follow the stream 
5 control packets SC of the second stream TS2 as well as the selected packets of the first frame 
of video data V3 of the second stream TS2. In case the stream control packets SC include 
PGR packets with video data, this video data is replaced with padding and adaptation flags 
(MPEGSYS) in order to satisfy Blu-ray standard restrictions. The extra video packets Vi and 
V3, selected before and after the exit and entry locations, are selected and copied in order to 
10 provide a bridge clip having a large enough size for fulfilling the Blu-ray requirements on the 
smallest clip size. The number of null packets inserted are selected for the same reason. In 
other standards these video packets might not have to be included in the bridge clip. The thus 
created bridge clip BC is shown in the middle of Fig. 3. 

Now that the bridge clip BC has been created the meta or overhead data 
15 associated with it is to be created, i.e. an entry point table EPbc- This entry point table is 

created firom the two previously mentioned entry point tables EPi and EP2 associated with the 
actual exit location AEX of the first transport stream TSl and the actual entry location AEN 
of the second transport stream TS2. The table EPbc is created through copying the entries of 
EPi and EP2, the actual SPN (Source Packet Number) value being corrected in order to match 
20 the actual bridge clip situation. Entries copied from EPi are subtracted with the value of SPN 
of V2. Entries copied from EP2 are subtracted with the value of SPN of V3 minus the number 
of video packets in the part of the bridge clip originating from the first stream TSl , 

Thereafter the control unit 26 ensures that the bridge clip is forwarded from 
the buffer 24 to the stream combining unit 28 to which the entry point table EPbc is also 
25 supplied, and these are combined there and supplied to the writing unit 30 for writing and 
storage on the disc 18 via the disc drive 14. 

In this w^ay the user can seamlessly coimect the actual entry and exit locations 
of the two streams using the bridge clip, by entering the bridge clip into the playlist between 
TSl and TS2. 

30 The described method is advantageous since it does not require any receding 

of the streamed data for the streams, but only copying together with the addition of null 
packets or other stream control packets. Because of this, the bridging process is enabled at 
small cost and without the above-mentioned complexity. It is furthermore fast and can be 
performed without any perceivable delays to the user. When the user wants to connect from 
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the first to the second stream, the bridge cHp is entered into the playlist and a seamless 
connection is obtained. The bridging position is probably slightly offset from the one selected 
by the user, which is hardly noticeable in a consumer environment. The invention 
furthermore does not need an encoder for its implementation, which means that it can be 
5 provided in a simpler and cheaper device, like for instance in a Blu-ray player. 

The bridging process was described, in the example above, in relation to 
sections of two separate streams. It should be realized that bridging can just as well be 
provided between two different sections of the same stream. The locations of connections 
could also be chosen virtually an5where inside the transport streams provided there are 
10 section start codes close at hand. In case there is no overhead information at hand, i.e. no 
entry point tables, the control unit would need to search the actual transport streams to find 
the section start codes. If there is no such overhead information there will also be no stream 
separating unit or stream combining unit in the device for bridging multimedia stream 
sections. 

15 The control unit is preferably provided in the form of a processor wiHi an 

associated program code for performing the method according to the invention. This program 
code can also be provided on a data carrier, such as a data carrier 34 in the form of a CD Rom 
disc as shown in Fig. 4. The program code can furthermore be provided on a server and 
downloaded into the multimedia presentation device. The multimedia presentation device 

20 furthermore need not be a Blu-ray disc player, but can for instance also be a computer like a 
PC (Personal Computer). 

It should be emphasized that the term "comprises/comprising" when used in 
this specification is taken to specify the presence of stated features, integers, steps or 
components, but does not preclude the presence or addition of one or more other features, 

25 iategers, steps, components or groups thereof. It should furthermore be realized that reference 
signs appearing in the claims should in no way be construed as limiting the scope of the 
present invention. 



